The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability

Abstract Background Implementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most are complex, socially mediated processes. Many complicated, expensive, and ultimately impractical deliver real-world settings. The field lacks methods assess the extent which usable aligned with needs constraints individuals contexts who will or receive them. Drawn from human-centered design, cognitive walkthroughs efficient assessment method potential identify aspects that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy as well example application post-training consultation support school mental health clinicians adopt measurement-based care. Method Cognitive Walkthrough Strategies (CWIS) is pragmatic, mixed-methods approach implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) prioritization; (4) convert tasks scenarios; (5) pragmatic group testing; (6) issue identification, classification, prioritization. A facilitator conducted two testing sessions clinician users ( N = 10), guiding participants through 6 scenarios 11 associated subtasks. Clinicians reported anticipated likelihood completing each subtask provided qualitative justifications during discussion. Following sessions, completed adapted quantitative usability. Results Average success ratings indicated substantial variability across Usability (scale 0–100) protocol averaged 71.3 SD 10.6). Twenty-one problems were identified via content analysis consensus coding, classified by severity problem type. High-severity included misalignment between service timelines digressions Conclusions was at low end “acceptable” range (based on norms unadapted scale). Collectively, 21 resulting issues explained data specific direction enhancements. current study provides preliminary utility generate blueprint redesign.